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ABSTRACT 

It  is  often  of  interest  to  find  the  global  extrema  of  a  given  differentiable  function.  Unfortunately  it  is  not  easy  to 
find  the  global  extrema  directly.  Thus  we  set  our  sights  a  little  lower  and  develop  necessary  and  sufficient  conditions  for 
finding  all  local  extrema. 
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INTRODUCTION 

Necessary  and  in  some  cases  sufficient  conditions  for  X  to  be  a  stationary  point,  were  developed  by  Kuhn  and 
Tucker  [11].  Many  of  the  algorithms  for  solving  problem  based  on  these  conditions,  and  termination  criteria  concerned 
with  recognizing  when  a  stationary  point  has  been  reached  are  derived  from  them.  Wilde  and  Beightler  (1967)  presented  a 
development  of  the  conditions  based  on  constrained  derivatives.  The  non-rigorous  formulation  given  here  uses  the 
Lagrangian. 

A  Necessary  Condition  for  Local  Extrema 

Given  a  function  f  :  I  — >  R  with  /  open,  it  is  desirable  to  develop  sufficient  conditions  for  local  extrema  to 
exist.  Then  the  stationary  points  found  can  be  examined  to  see  if  any  of  them  are  local  extrema. 

Theorem  1 

If  /  :  I  — >  R  is  differentiable  at  X1 ,  in  an  open  interval  I,  then  f  has  a  local  extremum  at  X1  £  /  =>  f'(xi )  =  0 . 
Proof  Suppose  X1  £  /  is  a  local  minimum.  By  assumption  /  (Xj )  exists,  and 

f(xl+Ax)-f(xl)  f{x,  +  Ax)-  f(x{)  m 

hm         A-         =hm         t- =  /(*.)■  (L> 

A.v->0+  ^x  A_v->0~ 

But  as  Xj  is  a  local  minimum,  there  exists  a  S  G  R  +  such  that  for  all  Ax  where  |Ax|  <  S 

/(*!+ As) -/(*,) 
Ax 

Hence  that  the  first  limit  in  (1)  is  non-negative.  However,  if 
Ax<0 
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As  it  is  in  the  middle  expression  in  (1),  we  have 

f(x1+Ax)-f(x1)  <Q 
Ax 

Hence  the  second  limit  in  (1)  is  non-positive.  As  /  (Xj)must  equal  both  of  these  limits,  one  negative,  one 
nonnegative  and  one  nonpositive,  they  must  both  be  zero.  Hence  f  (Xj)  =  0 

The  proof  when  Xj  is  a  local  maximum  is  similar 

/'(*,)  =  0 
Definition  1 

/has  a  point  of  inflection  at  Xjif  f  has  a  stationary  point  at  Xjbut  f  does  not  have  a  local  extremum  at  Xx  and  / 
has  a  local  extremum  at  x1  .This  leads  to  a  distinction  between  the  stationary  points  of  f. 

Definition  2 

/has  critical  point  at  Xj  if  f  has  a  stationary  point  at  Xx  and  Xx  is  a  local  extremum  for  f  but  not  for  /'  .Thus 
points  of  inflection  are  stationary  points  which  are  not  critical  points. 

Sufficient  Conditions  for  Local  Extrema 

In  view  of  Theorem  1,  it  is  desirable  to  develop  sufficient  conditions  for  local  extrema  to  exist.  Then  the 
stationary  points  found  can  be  examined  to  see  if  any  of  them  are  local  extrema.  To  this  end,  consider  the  Taylor  series 

expansion  about  a  point  x1  €  /  : 

/(x,  +h)  =  f(Xl )  +  hf\xx )  +  y /'(&,  +  (1  -  0)(xx  +  h)), 

For  some  0,0  <  0  <  1,  (2) 
Where  it  is  assumed  that  (xx  +  h)  G  /  , 

And  fhas  first  and  second  derivatives  f\x1 )  =  0  for  all  points  in  I.  Suppose  that  f  has  a  stationary  point  at  x1 . 
Then  by  Theorem  1 , 

/,(x1)  =  0. 

Then  (2)  can  be  rearranged  as: 

f(xl+h)-f(xl)  =  ^-f(0x1+(l-0)(xl+h)),  O<0<1  (3) 
Assume 
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/"(x1)>0 

Now  if  f    is  continuous  on  I,  at  all  points  sufficiently  near  Xj ,  f    will  have  the  same  sign  as  it  does  at  Xx ,  i.e. 
positive  .Thus,  for  all  h  sufficiently  small  in  magnitude, 

yA^+a +h))>o. 

Using  this  result  in  (3),  we  obtain 

fix,  +h)-f(Xl)>0. 

We  conclude  that  if 

/'(*,)  =  o. 

And  /  "  is  continuous  in  a  neighbourhood  of  Xx ,  then 

/"(x1)>0 

is  a  sufficient  condition  for  Xj  to  be  a  local  minimum. 
It  can  be  shown  analogously  that  if 

f\xl)  =  0, 

And  f  "  is  continuous  in  a  neighbourhood  of  Xx ,  then 

/"(x1)<0 

is  a  sufficient  condition  for  Xj  to  be  a  local  maximum. 

The  preceding  deductions  cannot  be  used  to  come  to  any  conclusions  about  the  character  of  Xj  if 

/•(x1)  =  /"(x1)  =  0. 

Indeed,  it  may  be  that 

/"(x,)  =  0,         n  =  l,2,-,k 

For  some  integer  k>2  the  following  theorem  settles  such  cases. 
Theorem  2 

If /*(xI)  =  0,  n  =  l,2,3  k  (4) 

and 

fk+\x,)±0  (5) 
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And  f(-k+l)  is  a  continuous  in  a  neighborhood  ofXj,  then  f  has  a  local  extremum  at  Xjif  and  only  if  (k+1)  is 

even.  If 

f(k+1)(x1)>0 

Xl  is  a  local  minimum.  If 

Xj  is  a  local  maximum. 

Proof:  (Sufficient  Condition) 

We  assume  the  hypothesis  of  Theorem  2.  We  wish  to  show  that  f  has  a  local  extremum  at  Xj  .Taylor's  Theorem 
about  point  Xx  yields 

7  2  7  k+l 

fix,  +h)  =  f(xl)  +  hfXxl)  +  —  nxl)  +  ...——f(k+l)((kl+(l-0)(xl  +h)), 

2  (k  +  l)\ 

For  some  9,  0  <  9  <  1  Using  (4)  and  rearranging,  this  becomes 
hk+x 

fix,  +  h)-f(xl)  =  ——fk+1\0x1+(l-0)(x1  +h)),O<0<l  (6) 
(k  +  V)l 

It  is  assumed  that  f(k+l)  is  continuous  atXj.  This  fact  can  be  used  to  show  that  at  all  points  sufficiently 
near Xt,  f(k+l\  will  have  the  same  sign  as  /(<r+1),X[.  Hence  if  h  is  sufficiently  small,  f('k+l)(9xl  +  (1  —  9)(x{  +  h)) 
will  have  the  same  sign  as  /       (xt )  . 

In  view  of  this,   on  examining   (6)   we   can   see   that  odd  k+l    and   sufficiently   small  positive  h, 
/(Xj  +  h)  — /(X[)has  the  opposite  sign  to  /(*+1)(X[)  .  Hence,  for  odd  k+l,  Xjis  not  a  local  extremum.  However,  if 

k+l  is  assumed  to  be  even,  f(x{  +  h)  —  f(x{ )  has  the  same  sign  as  / (<r+1)  (Xj )  ,  independently  of  the  sign  of  h.  If 

f(k+l)(xl)>0 
Then 

f(x1+h)-f(x1)>0 

For  all  h  sufficiently  small  in  magnitude  and  thus  Xx  is  a  local  minimum.  If 

/(*+1)CO<o 

Then^Xi+/*)-^Xi)<0 
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For  all  h  sufficiently  small  in  magnitude  and  thus  Xl  is  a  local  maximum 

We  assume  (4)  and  (5)  and  that  f  has  a  local  extremum  at  Xj  .We  wish  to  show  that  k+1  is  even.  Let  us  suppose 
for  definiteness  that  f  has  a  local  minimum  at  Xji.e. 

/(x1+/i)-/(x1)>0 

for  all  h  sufficiently  small  in  magnitude.  Using  (6)  we  obtain 
hk+l 

— —  f {k+1)  {Ox,  +  (1  -  0)(Xl  +  /*))  >0,  0< 0 <  1  (7) 

(k+iy. 

I.e.  the  expression  on  the  left-hand  side  of  (7)  is  of  constant  sign,  namely  positive.  However,  from  the  arguments 
mounted  earlier  in  the  proof  / (Qxl  +  (1  —  0)(x{  +  h))  will  have  constant  sign  (it  cannot  be  zero  if  (7)  is  to  hold)  for 
h  sufficiently  small  in  magnitude.  Now  when  h  is  negative  the  expression  in  (7)  can  have  constant  sign  only  if  k+1  is  even. 

A  similar  argument  follows  when  f  has  a  local  maximum  at  X, .  This  completes  the  proof. 

CONCLUSIONS 

We  developed  necessary  and  sufficient  conditions  for  finding  local  extrema.  Theorem  2  shows  that  f  has  a  local 
extremum  at  Xjif  and  only  if  (k+1)  is  even. 
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